Estimating Operational Validity Under Incidental Range Restriction: Some Important but Neglected Issues

Operational validities are important to personnel selection research because they estimate how well a predictor in practical use correlates with a criterion construct, if the criterion measure were purged of measurement error variance. Because range restriction on a predictor or predictor composite creates incidental range restriction on the criterion, existing methodologies offer limited information and guidance for estimating operational validities. Although these effects of range restriction and criterion unreliability could be corrected with existing equations in a sequential fashion, proper use of sequential correction equations is not always as straightforward as it appears. This research reviews the existing equations for correcting validities, outlines the appropriate method for correcting validity coefficients via sequential equations, and proposes a new equation that performs a combined correction for the effects of incidental range restriction and criterion unreliability

Estimating Operational Validity Under Incidental Range Restriction: Some Important but Neglected Issues

Operational validities are important to personnel selection research because they estimate how well a predictor in practical use correlates with a criterion construct, if the criterion measure were purged of measurement error variance. Because range restriction on a predictor or predictor composite creates incidental range restriction on the criterion, existing methodologies offer limited information and guidance for estimating operational validities. Although these effects of range restriction and criterion unreliability could be corrected with existing equations in a sequential fashion, proper use of sequential correction equations is not always as straightforward as it appears. This research reviews the existing equations for correcting validities, outlines the appropriate method for correcting validity coefficients via sequential equations, and proposes a new equation that performs a combined correction for the effects of incidental range restriction and criterion unreliability. Accessed 1,910 times on https://pareonline.net from August 06, 2017 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right

uC: Ubiquitous Collaboration Platform for Multimodal Team Interaction Support

A human-centered computing platform that improves teamwork and transforms the “human- computer interaction experience” for distributed teams is presented. This Ubiquitous Collaboration, or uC (“you see”), platform\u27s objective is to transform distributed teamwork (i.e., work occurring when teams of workers and learners are geographically dispersed and often interacting at different times). It achieves this goal through a multimodal team interaction interface realized through a reconfigurable open architecture. The approach taken is to integrate: (1) an intuitive speech- and video-centric multi-modal interface to augment more conventional methods (e.g., mouse, stylus and touch), (2) an open and reconfigurable architecture supporting information gathering, and (3) a machine intelligent approach to analysis and management of heterogeneous live and stored sensor data to support collaboration. The system will transform how teams of people interact with computers by drawing on both the virtual and physical environment

Ideological Labels in America

This paper extends Ellis and Stimson’s (Ideology in America. New York: Cambridge UniversityPress, 2012) study of the operational-symbolic paradox using issue-level measures of ideological incongruence based on respondent positions and symbolic labels for these positions across 14 issues. Like Ellis and Stimson, we find that substantial numbers—over 30 %—of Americans experience conflicted conservatism. Our issue-level data reveal, furthermore, that conflicted conservatism is most common on the issues of education and welfare spending. In addition, we also find that 20 % of Americans exhibit conflicted liberalism. We then replicate Ellis and Stimson’s finding that conflicted conservatism is associated with low sophistication and religiosity, but also find that it is associated with being socialized in a post-1960s generation and using Fox News as a main news source. Finally, we show the important role played by identities, with both conflicted conservatism and conflicted liberalism linked with partisan and ideological identities, and conflicted liberalism additionally associated with ethnic identities

Thinking Ahead: Assuming Linear Versus Nonlinear Personality-Criterion Relationships in Personnel Selection

Recent studies suggest that the form of some personality-performance relationships may be curvilinear, meaning that traditional top-down selection is inefficient in capitalizing on underlying personality-performance relationships. This study examines how mean performance is affected by how well the selection method is aligned with the nature of personality-criterion relationships. A simulation manipulated the linearity or nonlinear inflection point of predictor-criterion relationships, and several selection approaches were implemented that varied in level of congruence with these relationships. Results indicate that incongruence can produce notable decrements in mean performance under some conditions. Some evidence also suggests that decrements can be greater when linearity is assumed but relationships are nonlinear (vs. when nonlinearity is assumed but relationships are linear), selection ratios are smaller, and a single predictor is used

Response Rates for Mixed-Mode Surveys Using Mail and E-mail/Web

Abstract: This study examines response rates for mixed-mode survey implementation involving mail and e-mail/Web components. Using Dillman’s Tailored Design Method, 1,500 participants were sent a survey either (a) via mail with a follow-up contact via e-mail that directed them to a Web-based questionnaire or (b) via e-mail that directed them to a Web-based questionnaire with a follow-up contact via mail. Results indicate that these mixed-mode procedures produce moderately high response rates. However, the mail survey tended to be more effective than the e-mail/Web survey, when serving either as the initial contact or as the follow-up contact. These results suggest that survey implementation involving mail followed by e-mail/Web, or even mail-only approaches, may result in larger samples than implementation involving e-mail/Web followed by mail. Keywords: response rates; mail surveys; Web-based surveys; mixed-mode surveys Web-based survey techniques represent an important option for evaluators across disciplines. Among the potential benefits associated with Web-based surveys are convenient access to samples; reduced costs (e.g., Cobanoglu, Warde, & Moreo, 2001); faster responses (e.g., Bates, 2001; Yun & Trumbo, 2000); more interactive or tailored formats; quick troubleshooting; automated data collection, scoring, and reporting; and access to larger samples (e.g., see Birnbaum, 2004). Given these advantages across so many dimensions, program evaluators are increasingly using Web-based techniques (e.g., see Bierer, Fishleder, Dannefer

Fictitious issues revisited: political knowledge, interest, and the generation of nonattitudes

It has long been suspected that, when asked to provide opinions on matters of public policy, significant numbers of those surveyed do so with only the vaguest understanding of the issues in question. In this article, we present the results of a study which demonstrates that a significant minority of the British public are, in fact, willing to provide evaluations of non-existent policy issues. In contrast to previous American research, which has found such responses to be most prevalent among the less educated, we find that the tendency to provide 'pseudo-opinions' is positively correlated with self-reported interest in politics. This effect is itself moderated by the context in which the political interest item is administered; when this question precedes the fictitious issue item, its effect is greater than when this order is reversed. Political knowledge, on the other hand, is associated with a lower probability of providing pseudo-opinions, though this effect is weaker than that observed for political interest. Our results support the view that responses to fictitious issue items are not generated at random, via some 'mental coin flip'. Instead, respondents actively seek out what they consider to be the likely meaning of the question and then respond in their own terms, through the filter of partisan loyalties and current political discourse

Deliberation, political knowledge and vote choice: Results from an experiment with second-order elections

This article assesses the effects of deliberation and increased political knowledge on vote choice. The observed knowledge gains result from participation in a deliberative experiment in the context of second-order elections, which facilitates realistic estimates of information gains that can be expected if citizens were politically more engaged than they actually are. Using survey data on 333 participants in the deliberative experiment and 729 respondents from a control group, we find that deliberation is associated with significant changes in vote choice. Specifically, participating in the deliberative event is related to an increased likelihood of vote switching in favour of Green parties. However, there is no support for the expectation that changes in citizens’ party choices are related to the observed increase in political knowledge